The synchronization of stochastic oscillators 



O 
O 

(N 

< 
o 



0\ 

6 : 

x> : 
i 

cr 



> 

(N 
(N 
O 
oo 
O 

o 



I , 



X 



Amitabha Nandi 1 , Santhosh G. 1 , R. K. Brojen Singh 2 , and Ram Ramaswamy 1,2 
1 School of Physical Sciences, Jawaharlal Nehru University, New Delhi 110067, India 
2 Center for Computational Biology and Bioinformatics, School of Information Technology, 
Jawaharlal Nehru University, New Delhi 110061, India 
(Dated: February 6, 2008) 

We examine microscopic mechanisms for coupling stochastic oscillators so that they display similar 
and correlated temporal variations. Unlike oscillatory motion in deterministic dynamical systems, 
complete synchronization of stochastic oscillators does not occur, but appropriately defined oscillator 
phase variables coincide. This is illustrated in model chemical systems and genetic networks that 
produce oscillations in the dynamical variables, and we show that suitable coupling of different 
networks can result in their phase synchronization. 

PACS numbers: 02.50.Fz, 05.40.-a, 05.45.Xt, 82.20.Fd, 87.19.Jj 



The concerted behaviour of different stochastic pro- 
cesses can be of considerable importance in a variety of 
situations. Examples from a biological context 0] range 
from the synchronized firing of groups of neurons |3| to 
the occurence of circadian or ultradian cycles 0, in 
groups of metabolic and cellular regulatory processes, 
each of which is individually stochastic. Similar phenom- 
ena also occur in other areas of study, such as weather 
modeling or the study of coupled populations @. It is 
therefore a moot question whether there is a sense in 
which two or more independent (or unrelated) stochas- 
tic phenomena can become temporally synchronized. In 
this Letter we consider mechanisms through which such 
synchronization can be effected, and examine measures 
through which the synchronization can be detected. 

The synchronization of coupled nonlinear oscillators 
has been studied extensively in the past two decades. 
Both chaotic and nonchaotic oscillator systems can show 
complete synchronization, when all variables of the sys- 
tems coincide, as well as more general forms such as 
phase, generalized, or lag synchronization [(|. Studies 
have examined a variety of different coupling schemes 
and topologies, and the robustness of synchronization to 
noise. In the typical cases examined, the noise is external 
and thus appears largely as additional stochastic terms 
in otherwise deterministic dynamical equations 0, II] • 

For the systems we study here the evolution is 
intrinsically stochastic. Such systems do not follow de- 
terministic equations of motion: a master equation de- 
scribes the evolution of configurational probabilities , 



dt 



P{C, t) = -J2 P ( C > t)Wc-+c> + P ( C '' tWc^C 

c 



(1) 

where in standard notation [lfjj, P(C, t) is the probability 
of configuration C and the W's are transition probabil- 
ities. The configurations that are realized as a function 
of time give a probabilistic description of the system as 
it traverses the state space of the problem. 

Consider now two such independent systems, each of 



which can be described by a (reduced) master equation 
of the above form. Starting with similar configurations, 
C, the subsequent evolution of each of the subsystems 
will typically be quite distinct. The concern here is to 
(a) examine conditions under which the two subsystems 
synchronize, namely follow very similar paths in the state 
space, and to (b) detect this phenomenon. 

Our main result can be stated in general terms as fol- 
lows. When the two systems are coupled by employing a 
mediating process, then variables of the two subsystems 
phase-synchronize, namely they vary in unison. Such 
synchronization depends on the nature and strength of 
the coupling and can persist even when fluctuations are 
large. 

It is simplest to illustrate this through an example. 
The stochastic dynamics of the Brusselator model, which 
has been studied extensively derives from considera- 
tion of the following "chemical" reactions ^3 



(2) 
(3) 

(4) 
(5) 



A master equation formalism is exact for this system 
in the gas phase and in thermal equilibrium |l3| , and in- 
deed is necessary when the number of molecules is small. 
On the other hand, in the thermodynamic limit, when 
fluctuations are negligible, one can derive a set of deter- 
ministic reaction-rate equations for the concentrations of 
species X and Y, 

x = ci - c 2 x + c 3 x 2 y - c A x = f x (x,y) (6) 
V = c 2 x - c 3 x 2 y ee f y (x, y). (7) 

These rate equations usually have to be integrated nu- 
merically to determine the orbits (for the parameters 
here, a limit cycle). Similarly, the corresponding master 
equation cannot be solved analytically and recourse must 
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be made to Monte Carlo simulations [T^. The number 
of molecules of species X or Y (taking the volume to be 
unity) will vary in a stochastic manner, giving a (noisy) 
limit-cycle solution to Eqs. (2-5). 

Another Brusselator system (denoted by similar equa- 
tions, but with primed variables and parameters, say) 
would also naturally give a noisy limit cycle solution, the 
characteristics of which would depend on the parameters 
of the problem. Thus if the parameters {cj} and {c^} 
are different the evolution of the two subsystems will be 
independent and uncorrelated. 

We consider two scenarios where the subsystems are 
coupled at the microscopic level. In the "direct" case, we 
take the species X and X' to be identical: the subsystems 
share a common drive. We find that for any finite volume 
this coupling results in the temporal variation of species 
Y and Y' rapidly becoming highly correlated, even if the 
fluctuations are large. 

Alternately one may consider an "exchange" process, 
when species X and X' can interconvert. This introduces 
an additional reaction, 



X 



X' 



(8) 



that serves to couple the subsystems, and depending on 
the rate of interconversion (governed by c and c'), species 

Y and Y' show synchronization. 

Although both direct as well as exchange coupling 
mechanisms effect synchronization, they differ in the de- 
tails of how they act. Fig.Q]shows the variation of species 

Y and Y' as a function of time, from stochastic simula- 
tions as well as the so-called chemical Langevin approach 
fl(j| . which effectively adds stochastic noise to the deter- 
ministic dynamics, Eqs. I|6I7|) . Clearly the two concentra- 
tions vary in unison. However, due to intrinsic stochastic 
fluctuations the two solutions do not become identical 
but only phase-synchronize |l7j as we now show. 

To judge the phase synchronization of two stochastic 
oscillators, it is necessary to first obtain the phase for 
a single oscillator. The Hilbert phase of a signal s(t) is 
obtained |l7^ by first computing its Hilbert transform, 



ws(t) = P. V. 



s(t) 



dr 



(9) 



(P. V. denotes principal value) and defining the instan- 
taneous amplitude A(t) and phase <p(t) through 



A(t)e*+® = s(t)+is(t). 



(10) 



The difference in the Hilbert phases 4> and 4>' of the 
two stochastic oscillators is shown in Fig. [21 When the 
subsystems are uncoupled, the phase difference |</> — </>'| 
increases linearly in time on average since the oscillators 
evolve independent of one another. With coupling the 
two oscillators phase-synchronize and the phase differ- 
ence fluctuates around a constant value. 
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FIG. 1: (Colour online) Species Y and Y' as a function 
of time for the coupled Brusselator system. The parameter 
C2 = 50 differs from c' 2 — C2 + 5. The other parameters are 
ci = c'j = 5000, c 3 = c' 3 = 0.000025 and c 4 = c' A = 5. 
(a) Stochastic simulation results for Y and Y' using direct 
coupling, (b) As in (a), but for the case of exchange coupling, 
Eq. (8) with c = c = 0.6. (c) Results obtained by solving the 
chemical Langevin equation ^(| with 7 = 0.01. 
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FIG. 2: (Colour online) Phase difference with parameter mis- 
match for the Brusselator model for (a) direct coupling of 
species X and X , and (b) exchange coupling, for different 
strengths. 
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FIG. 3: Biochemical network of the extended circadian os- 
cillator model. Da and D' A denote the number of activator 
genes with and without A bound to its promoter respectively, 
and Dr, D' r and Ds, D' s , refer to the two repressors driven 
by the common promoter A. Ma, Mr and Ms denote mRNA 
corresponding to the activator A, and the repressors R and S. 
C and C' corresponds to the inactivated complexes formed by 
A and R, and A and S respectively. The constants a and a' 
denote the basal and activated rates of transcription, the 
rates of translation, 5 the rates of spontaneous degradation, 7 
the rates of binding of A to other components, and 6 denotes 
the rates of unbinding of A from those components. See [2o|. 



The coupling schemes discussed here can bring about 
stochastic synchronization in a very general setting. Con- 
sider, for example, a model circadian oscillator that has 
been quantitatively studied in some detail recently |18| . 
Shown in Fig- El is the biochemical network for two such 
oscillators coupled with a common drive, namely two ge- 
netic circuits with a common activator. In effect a single 
activator binds to two promoter sites for repressor pro- 
teins R and S, a fairly commonplace situation. Each in- 
dividual circuit gives stochastic oscillations in the num- 
ber of repressor molecules. When the two systems are 
coupled the stochastic oscillations of the two subsystems 
rapidly phase-synchronize. The synchronization is ro- 
bust to parameter variation: in the examples shown in 
Fig. QJ the corresponding parameters of the two subsys- 
tems differ by as much as 10%; nevertheless the variables 
of the two systems oscillate in phase in a stable and sus- 
tained manner. 

The temporal behaviour of the two repressors and their 
phase difference for both direct and exchange coupling 
are shown in Fig. 0] In (a) the two systems are initially 
uncoupled and therefore evolve independently. The cou- 
pling is switched on for t > 2000, leading rapidly to a 
constant phase difference, indicative of the phase syn- 
chronization (Fig. Efb)). In the case of exchange cou- 
pling the genetic circuit differs somewhat from Fig. [3] 
the circuit of Ref. [18| is essentially doubled, and there 
is an additional activator A' . Through the equivalent of 
Eq. (8) the activators of the two circuits are allowed to 
interconvert, and the two subsystems synchronize as can 
be seen in Fig. EJc-d). 

Examination of the macroscopic dynamics offers some 
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FIG. 4: (Colour online) Temporal behaviour and phase dif- 
ference of the repressors in the circadian oscillator model, 
(a) The repressors are initially uncoupled and the coupling 
is switched on (vertical arrow) at time t > 2000. (b) The 
corresponding phase difference, which becomes constant for 
t > 2000. (c) Time-series of the repressors oscillating in uni- 
son for diffusive coupling with c = d — 0.55. (d) Phase 
differences for various c. 



clues as to how the stochastic oscillators synchronize. 
While the master equation description is formally exact 
at the microscopic level, the kinetic equations that de- 
scribe the system at a macroscopic level can be derived 
from Eq. Q by first obtaining the generating function 
representation, followed by a cumulant expansion |Tflj to 
give a set of ordinary differential equations, 



f(x,t) + o(I) + o(-^; 



(ii) 



in the variables Xi = (X{)/V, namely the average con- 
centrations, with "noise" corrections that depend on the 
system volume V. Coupling two such systems as dis- 
cussed above would give a set of coupled stochastic dif- 
ferential equations, and the circumstances under which 
these will pha se synchronize have been studied to some 
extent la. |23|. The direct coupling, in the determinis- 
tic limit |l2l Il4j leads to dynamical equations which are 
similar (but not identical) to those that derive from the 
coupling scheme proposed by Pecora and Carroll for 
the synchronization of chaotic oscillators. Although it is 
not possible to define Lyapunov exponents for stochastic 
systems, analysis of the deterministic limit gives indica- 
tions of what coupling schemes could be effective. Mak- 
ing species Y the common drive between the two Brus- 
selator subsystems does not serve to synchronize them 
but instead leads to the stochastic analogue of oscillator 
death. 

Similarly, the exchange process, Eq. (8) results in diffu- 
sive coupling [2l| in the kinetic equations for the species 
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X and X' , namely terms of the form c(x' — x). The 
conditions under which this form of the coupling leads 
to synchronization have also been studied |2l|. As can 
be seen from the examples presented here, the systems 
synchronize when the effective coupling exceeds a thresh- 
old strength (Figs. 2(b) and 4(d)). The rate of growth of 
the phase difference vanishes at this threshold as a power 

H2- 

Stochastic oscillators appear to effectively synchronize 
independent of the size of fluctuations, in a manner sim- 
ilar to chaotic synchronization [l5j . However, even when 
the parameters are identical, exact synchronization is not 
possible and the systems can only phase-synchronize. 

The synchronization of stochastic oscillators thus has 
similarities to the analogous process in deterministic dy- 
namical systems (both with and without added noise), 
but also important differences. The mechanisms that 
we have described here pertain to systems with intrin- 
sic stochasticity, and are therefore in a nonperturbative 
limit. 

The coupling schemes that we have proposed here can 
find application in the design and control of synthetic bi- 
ological networks where synchronous oscillation may be 
a desirable feature. McMillen et al. [24| have shown that 
intercell signaling via a diffusing molecule can couple ge- 
netic oscillators and effect synchrony. The present results 



indicate that such phase synchrony can emerge under 
very general conditions with high levels of ambient noise. 
In a related vein, one can speculate that similar mech- 
anisms underlie the synchrony that is so dramatically 
evident in cellular processes. As recent time-resolved 
microarray experiments of yeast have revealed, the mul- 
titude of variable gene expression patterns classify into a 
small number of groups, all genes of a givengroup hav- 
ing very similar temporal variation profiles |3|]. We have 
observed that the above coupling schemes are effective 
in synchronizing ensembles of stochastic oscillators [25| . 
Other physical situations where such mechanisms may be 
relevant are in the study of coupled ecosystems or coupled 
weather systems: individual subsystems show stochastic 
dynamics, which however have phase synchrony 

Although we have discussed the explicit case of 
stochastic oscillators, there is reason to believe that sim- 
ilar microscopic intersystem couplings can bring about 
temporal correlations in more general stochastic systems. 
Investigations of such phenomena are currently under 
way [25| . 
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